Amendments to the Specification: 

Please replace the Specification of the present application, including the 
Abstract, with the following Substitute Specification. A marked-up version of the 
Substitute Specification and Abstract is attached hereto. 
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PRODUCTION OF A COMPLETE IMAGE BY SCANNING PARTIAL 
AREAS OF A PATTERN 

BACKGROUND 

5 The present disclosure relates to a method for producing a resulting image 

from a plurality of individual images. 

Such a method can, for example, be used to obtain a panoramic image, or to 
scan documents. 

The solid angle given by a camera and objective, that is scanned or recorded 
10 by an image, is in many situations inadequate for completely recording objects 
from the surroundings. In particular, the use of wide-angle objectives to 
completely record objects is not always possible, or always desired. Because of the 
characteristics of lenses, a very wide-angle objective causes extreme distortions at 
the edges of the image that interfere considerably with the impression. 
15 Furthermore, the quality of the display of the object is disturbed by the limited 
sensor resolution. In addition, in many cases, replacement of the lens or of the 
objective is not possible, because the component is firmly integrated into the 
camera. 

Many previous methods have attempted to deal with a similar subject 
20 related to the generation of panoramic images, correcting the sensor defect. 
However, the known previous methods for generating images of a larger field of 
vision require very expensive and complex arithmetical operations that cannot be 
performed in real time video to correct the lens and image distortion. For this 
reason, a calculation of an image with an extended field of vision can generally 
25 only be performed offline. 

The images used to generate the resulting image of the previous methods 
only require a slight overlap in the individual images. In those cases, two adjacent 
images or two consecutive images contain only a little common image information. 
Furthermore, depending on the environment, the images may contain quite different 
30 lighting conditions. Therefore, as a result of an aperture control on the camera, 
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there will exist extremely varied illuminations at the spliced edges of the resulting 
image, that can likewise only be harmonized at a very great cost. 

Fax equipment and flatbed scanners enable the electronic transmission of 
documents which are available on paper. In many situations this type of equipment 
5 is not available, for example, during a meeting. An alternative to the use of a fax 
machine or a flatbed scanner is such a situation is a digital camera, with which the 
image information can be saved in digital form. However, the resolution of 
standard commercial cameras is not yet sufficient to produce adequate resolution 
for a document in a single exposure. 
10 The scanning of documents by means of many individual images close up to 

the document to increase the resolution is a known approach. Until now, however, 
there have only been a few, in part, very unstable methods that can be used to 
compose a two-dimensional complete image from the individually recorded 
images. 

15 Most of these methods are based on the image information first being 

distorted at an initial processing stage by highly complex arithmetical operations. 
Then, at a subsequent processing stage, the adjacent image information is 
harmonized with the adjacent images in all four edge directions. Each image is 
corrected both horizontally and vertically in relation to the adjacent images. The 

20 images, therefore, only require a slight overlap to accomplish this. Besides the 
scarcely tolerable high calculation time, these methods frequently lead to rhombic 
distortion of the image information which distracts the observer greatly, as shown, 
for example, in Figure 1. On account of their complexity, the known methods can 
generally only be performed interactively, and offline. 

25 SUMMARY 

The present disclosure relates to a method for providing a high-quality 
resulting image from a plurality of individual images, without a great amount of 
calculation. 

An example of the method for producing a resulting image from a plurality 
30 of individual images according to the present disclosure comprises producing the 
plurality of individual images using a scanning movement, offsetting the individual 
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images in relation to each other, obtaining image information from the individual 
images as a function of the offsetting, and producing the resulting image using the 
obtained image information.. 

Some benefits of the method according to the present disclosure include the 
5 rapid processing of the images to produce a resulting image, elimination of the need 
to correct the lens errors or mapping errors in the image utilizing intensive 
calculations, elimination of the need to harmonize the illumination at the spliced 
edges, and controlling the image information as a function of the offsetting. 

BRIEF DESCRIPTION OF THE DRAWINGS 
10 Figure 1 shows an example of a resulting image prepared from individual 

exposures according to the prior art. 

Figure 2 shows an example of a resulting image generated by scanning the 
surroundings. 

Figure 3 illustrates an example of a scanning movement for scanning a 
1 5 document. 

Figure 4 illustrates an example of the image recorded during the scanning 
movement according to Figure 2. 

Figure 5 illustrates an example of the result of successive one-dimensional 

scans. 

20 Figure 6 illustrates an example of the resulting image according to the 

present disclosure. 

DETAILED DESCRIPTION OF THE PRESENT EXAMPLES 
The method according to the present disclosure is based on the production 
of individual images which are generated during a one- or two-dimensional 
25 scanning movement. 

According to the present disclosure individual images are generated which 
overlap each other to a high degree. This produces a resulting image with almost no 
distortions that covers a very large solid angle. This also makes it possible, for 
example, to produce panoramic images or to scan in documents with a very high 
30 resolution. 
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In doing so, the image sensor operates, for example, at full scanning 
frequency, so that by slowly swiveling across the object to be recorded, adjacent 
images are only slightly offset against each other. From each image, a part of the 
undistorted image information is copied from the center of the image into a 
5 resulting image. The size of the copied portion detail is controlled as a function of 
the calculated offset to the previous image. As two adjacent images overlap to a 
very high degree, the images have almost identical lighting conditions so that when 
adjacent edges are put together, as a rule no harmonization of the illumination is 
necessary. 

10 An embodiment of the method according to the present disclosure could, for 

example, be used with a mobile telephone having a camera module for recording 
images from the surroundings, a processor for processing image data and for 
generating the resulting image (i.e., estimate of movement, image composition, 
etc.), and a display for displaying the resulting image. 

15 An example of generating the resulting image as shown in, for example, 

Figure 2, on the basis of an image sequence, includes processing the estimation of 
movement of two adjacent images, as well as the structure of the resulting image. 

The above methods are explained in more detail herein with the assumption, 
for illustrative purposes only, that the scan follows the surroundings one- 

20 dimensionally from right to left. 

Regarding the estimation of movement of two adjacent images, the 
movement is determined, for example, according to a MSE (Mean Squared Error) 
method. In the MSE method, the best possible match in a local neighborhood to the 
previous image is sought for an image area of the initial image. The best match 

25 provides the displacement vector of the two images relative to each other. 

Regarding the structuring of the resulting image, using the displacement 
vector, the position inside the resulting image to which the additional image 
information is copied is ascertained. The width of the copied portion detail of the 
initial image is provided by the offset of the images in the direction of scanning, for 

30 this example in the horizontal direction from right to left (i.e., direction x). In this 
way no gap arises between the copied portion detail already put together and the 
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added copied portion detail. Perpendicular to the direction of scanning (i.e., 
direction y), the complete image information is taken into account. The result of the 
processing of many images according to this method can be seen, for example, in 
Figure 1 . 

5 According to the present disclosure, scanning of the document takes place 

by means of a zigzag movement of the camera across the document at a constant 
distance, as shown in, for example, Figure 3. In order to avoid variations in the 
distance to the document and consequently changes in the size of the images during 
the scanning process, for example, the camera is guided across the document on a 

10 frame with the camera pointing downwards towards the document to be scanned. 
By analyzing the movement of consecutive images, the two-dimensional scan is 
separated into several one-dimensional (i.e., horizontal) scans as shown, for 
example, in Figures 4 and 5. Each one-dimensional scan shows a horizontal, 
undistorted strip of the original document. By separating the two-dimensional scan 

15 into several one-dimensional scans, the document generation task is reduced to 
horizontal scaling of the image strips, and the putting together of the horizontal 
strips in a vertical direction, as shown, for example, in Figure 5. By linearly scaling 
all of the image information, rhombic distortions are avoided in the complete 
resulting image, as occurs in traditional previous methods, as shown in, for 

20 example, Figure 6. 

It should be understood that various changes and modifications to the 
presently preferred embodiments described herein will be apparent to those skilled 
in the art. Such changes and modifications can be made without departing from the 
spirit and scope of the present invention and without diminishing its intended 

25 advantages. It is therefore intended that such changes and modifications be covered 
by the appended claims. 
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